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FOURTH  INTERNATIONAL  CONFERENCE  ON  ROBOT 
VISION  AND  SENSORY  CONTROLS 

I  tit  roduct  ion 

The  Fourth  International  Conference 
on  Robot  Vision  and  Sensory  Controls  was 
held  in  London  from  9  through  II  October 
1984. 

Forty-seven  papers  were  presented 
covering  nine  categories:  sensor-based 
manufacturing  I,  vision  systems,  sensor- 
guided  welding,  three-dimensional  (3-D) 
sensing,  robot  guidance  and  sensory  con¬ 
trol  ,  nonvision  sensing,  knowledge-based 
sensory  systems,  advanced  vision  tech¬ 
niques,  and  sensor-based  manufacturing 
II.  Thirteen  nations  were  represented 
among  the  speakers,  with  the  largest 
number,  17,  coming  from  the  UK  and  the 
second  largest  number,  11,  coming  from 
the  US.  The  number  of  delegates  attend¬ 
ing  was  170. 

Sensor-Based  Manufacturing  1 

G.L.  Pope  (UK)  described  an  imple¬ 
mentation  of  a  vision-processing  algo¬ 
rithm  to  perform  robot  stack  picking  in 
a  flexible  manufacturing  system's  cell. 
He  described  in  detail  the  stages  of  the 
algorithm  from  image  collection  to  coor¬ 
dinate  selection. 

H.  Jochnick  described  a  vision  sys¬ 
tem  developed  at  ASEA,  a  Swedish  robot¬ 
ics  company,  in  parallel  with  their 
second-generation  robot  controller.  The 
programming  unit  consists  of  a  two-row 
alphanumerical  display  and  a  number  of 
control  buttons.  The  upper  row  of  char¬ 
acters  is  used  to  display  prompting  and 
informative  or  error  messages,  while  the 
lower  row  is  user!  to  label  five  keys  to 
form  a  programmable  menu.  The  five  pro¬ 
grammable  keys  and  the  numerical  keypad 
are  used  for  vision  programming.  A  but¬ 
ton  with  a  camera  symbol  is  used  to 
cuter  the  vision  subsystem.  Any  other 
butter  will  return  to  robot  mode.  A  CRT 
monitor  ''  s  used  for  displaying  either 
camera  video,  edge  data,  or  the  two 
superimposed  on  each  other.  Under  the 
PROG  Label,  when  programming  vision  sys¬ 
tems  the  flow  of  programming  goes  from 
left  to  right.  In  this  mode  under  TPICT 
(the  command  to  take  the  picture)  the 


operator  is  given  the  option  of  adjust¬ 
ing  the  analog  input  circuitry  with  a 
contrast  and  brightness  control,  or  of 
setting  a  sensitivity  control  for  the 
classification  of  gradients.  The  next 
step  is  to  place  the  object  to  be  pro¬ 
grammed  into  the  system  under  the  camera 
and  depress  the  DEFINE  button.  The 
vision  system  will  extract  contours  of 
the  object,  including  contours  inside 
the  perimeter  of  the  object.  The 
operator  can  select  a  significant  part 
of  the  surface  by  using  a  cursor  and 
depressing  SURFACE.  The  operator  may 
depress  VIEWRDY  and  cause  the  view  of 
the  model  to  be  examined  by  the  system. 
Several  parameters  will  be  extracted 
based  on  the  features  and  an  orientation 
algorithm.  Statistical  data  are  col¬ 
lected  using  the  TRAIN  label.  The  grip¬ 
ping  point  of  the  object  is  taught  to 
the  system  by  depressing  ROBOTP.  With 
the  aid  of  the  robot  the  object  is 
placed  under  the  camera,  and  the  posi¬ 
tion  is  recorded  by  depressing  F.NDPOS. 
The  operator  opens  the  robot’s  grippers 
and  removes  the  robot  from  the  field  of 
view.  When  the  READY  button  is  depress¬ 
ed,  the  system  processes  the  object  and 
creates  a  transformation  from  its  in¬ 
ternal  representation  of  the  object  to 
the  gripping  point.  The  transformation 
is  stored  in  the  database. 

In  a  paper  entitled  "Machine  Vi¬ 
sion — The  Link  between  Fixed  and  Flexi¬ 
ble  Automation,"  D.  Banks  (US)  described 
the  elements  of  productivity  currently 
achieved  with  machine  vision.  Banks  pre¬ 
dicted  that  low  machine  vision  can  be  a 
bridge  technology  between  fixed  and 
flexible  automation.  Sensory  automation 
is  vital  if  computer-integrated  manufac¬ 
turing  is  to  become  a  reality.  Use  of 
machine  vision  now  expedites  practical 
development  of  the  technology  is  well  as 
user  expertise. 

A  paper  by  E.-.I.  Schmidberger  (West 
Germany)  described  quality  control  for 
automobile  chassis  parts,  including 
recognition  of  deformations  such  as 
cracks,  overlaps,  folds,  and  missing 
punched  holes.  Until  now  this  quality 
control  has  been  accomplished  mainly 
by  stationary  sensors.  The  system  for 
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per  form  iiit;  such  tasks  described  in  the 
paper  includes  an  industrial  robot  which 
guides  a  camera  to  certain  typical  loca¬ 
tions  on  the  part's  surface  where  de¬ 
formations  are  most  likely  to  occur. 

Vision  Systems 

In  a  paper  entitled  "Solving  Illu¬ 
mination  Problems,"  D.A.  Hill  (UK) 
described  illumination,  optical,  envi¬ 
ronmental,  and  sensor  problems.  The 
optical  problems  arise  as  a  result  of 
too  much  or  too  little  reflectivity  in 
the  object  and  its  surface  curvature. 
Kuv  i  ronmenfo 1  problems  associated  with 
illumination  include  excessive  heat, 
physical  arrangement  of  the  work  place, 
and  vibration  of  machinery.  Among  sen¬ 
sor  problems  ate  the  interference  of 
sensors  with  objects  being  sensed  and 
vice  versa.  Excess  illumination  may  be 
corrected  by  reducing  the  intensity  of 
the  source,  introducing  filters,  or 
changing  the  direction  of  illumination. 
Insufficient  illumination  may  be  cor¬ 
rected  by  using  two  medium-sized  sources 
instead  of  one  larger  one,  changing  the 
light  direction,  and  checking  the  com¬ 
patibility  of  the  accessories  with  the 
light  source. 

The  problem  of  lack  of  uniformity 
ot  illumination  may  he  due  to  images,  or 
shadows  of  components,  which  are  part  of 
the  lamp  providing  the  illumination. 
Another  cause  may  he  the  sensitivity  of 
came ras.  The  effectiveness  of  condens¬ 
ing  lenses  can  be  further  improved  by 
etching.  Front  illumination  problems 
may  benefit  from  the  use  of  quartz 
halogen  1  amps  with  integral  multi-mirror 
ior  multi-facet)  dichroic  reflectors. 

Lack  of  contrast  may  be  corrected 
by  a  change  of  background.  Offsetting 
■ne  point  of  light  against  another  so 
that  they  "interfere"  with  one  another 
may  reveal  salient  features. 

P.  Levi  (West  Germany)  described 
tiic  architecture  and  the  operation  of  a 
linear  processor  array  for  iconic  image 
processing.  The  fundamental  data  struc¬ 
ture  contacts  of  two-dimensional  (2-D) 
"iat  rices.  The  elements  of  these  matric- 
are  essentially  gray-scale  intensity 
data  (2S6  levels!  and  distance  data 


obtained  by  a  laser  scanner  using  tri¬ 
angulation.  The  parallel  computer  sys¬ 
tem  consists  of  an  array  of  64  process¬ 
ors.  An  array  controller  supervises 
these  processors.  A  microprogrammable 
address  sequencer  divides  the  input 
images  into  64  windows.  The  gray-scale 
vision  system  can  operate  either  in  the 
single-instruction-multiple-data  mode  or 
in  the  multiple-instruction-multiple- 
data  mode.  The  system  is  mainly  design¬ 
ed  for  3-D  object  descriptions  which  are 
needed  for  the  part  handling  of  an  as¬ 
sembly  robot.  In  the  first  step  intens¬ 
ity  and  distance  data  are  combined  to 
get  integrated  intrinsic  images.  Intern¬ 
al  3-D  models  are  based  on  linear  oct- 
trees  and  are  generated  using  distance 
data. 

In  a  paper  entitled  "Vision — New 
Sight  and  Foresight,"  H.A.  Laird  (UK) 
described  the  components  of  vision  sys¬ 
tems  which  are  commercially  available, 
and  examined  their  suitability  for 
metal-forming  operations.  One  area  of 
application  which  he  cited  was  the 
analysis  of  strain  caused  by  deformation 
processes,  which  is  a  time-consuming 
process  when  one  uses  the  conventional 
grid-circle-analysis  technique. 

L.  Norton-Wavne  (UK)  described  a 
set  of  40  shapes  for  the  benchmark 
testing  of  silhouette-recognition  sys¬ 
tems.  Benchmark  testing  is  essential  if 
silhouette  image  processing  systems  are 
to  be  evaluated  and  compared  objective¬ 
ly,  and  if  the  state  of  the  art  is  to 
advance.  The  40  shapes  were  selected  to 
probe  for  particular  weaknesses,  which 
were  described  and  explained.  The  set 
tests  accuracy  in  orientation  and  loca¬ 
tion,  and  the  ability  to  distinguish 
shapes  which  are  similar. 

D.  Lake  (US)  discussed  the  use  of 
solid-state  imagers  in  complete  cameras 
and  camera  systems.  The  first  part  of 
his  presentation  dealt  with  line-scan 
cameras,  the  second  with  matrix  cameras, 
and  the  third  with  cameras  which  do  not 
image  directly  through  a  lens  but  rather 
use  fiber  optics  and  intensifier 
tubes.  Within  each  section,  appropriate 
critical  parameters  were  emphasized. 
Such  parameters  include  resolution. 
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acquisition  rate,  monochrome  versus 
color,  (dynamic  range,  noise,  size,  and 
ruggedness. 

A  256*256-pixel ,  charge-coupled- 
device  (CCD),  solid-state  image  sensor 
was  described  by  G.  Boucharlat  (France). 
This  device  was  designed  and  developed 
for  shape  recognition  and  image-signal 
processing.  It  has  square  photosites 
with  antiblooming,  a  pseudo-random  ac¬ 
cess  adaptable  organization,  an  elec¬ 
tronic  exposure  time  control,  and  a 
sampled  video  output.  it  is  built  with 
metal  oxide  semiconduc tor-CCD  technol¬ 
ogy.  It  possesses  the  advantages  of 
small  size,  reliability,  low  power 
consumption,  and  insensitivity  to  elec¬ 
tromagnetic  field  disturbances.  Per¬ 
formance  and  operating  modes  for  the 
device  were  presented. 

Sensor  Guided  Welding 

Z.  Smati  (UK)  described  a  laser 
guidance  system  for  robots.  Adaptive 
arc-welding  and  seam-tracking  systems 
rely  on  the  successful  combination  of 
various  technologies  including  position 
sensors,  welding-power  sources,  manipu¬ 
lators,  and  industrial  robots.  Sensors 
are  expected  to  be  a  key  element  in  the 
development  of  any  such  adaptive  auto¬ 
matic  system.  Arc-based  sensors  and 
optical  sensors  were  reviewed  by  Smati, 
with  special  emphasis  on  laser  systems 
using  triangulation.  A  detailed  descrip¬ 
tion  of  an  adaptive  welding  system  based 
on  a  laser  range  finder  was  given.  The 
system  described  has  been  used  to  con¬ 
trol  directly  each  axis  drive  of  a  four- 
degrees-of-f reedom  manipulative  arm  to 
follow  complex  paths;  the  algorithm  used 
for  image  recognition  was  described.  The 
application  of  this  system  to  metal 
inert  gas  welding  of  pipes  and  the  use 
of  an  industrial  six-degrees-of-f reedom 
robot  for  linear  tracking  was  also  dis¬ 
cussed  . 

J.E.  Agapakis  (US)  described  gener¬ 
al  visual  sensing  techniques  for  automa¬ 
ted  welding  fabrication.  Welding  fabri¬ 
cation  involves  preparation,  process  ex¬ 
ecution  and  post-wold  inspection.  A  maj¬ 
or  problem  in  automating  these  steps  and 
developing  autonomous  welding  systems  is 


the  lack  of  proper  sensing  strategies. 
Conventionally,  machine  vision  is  used 
in  robotic  arc  welding  only  for  the 
correction  of  pre-tnught  welding  paths. 
In  his  paper,  Agapakis  described  novel 
uses  of  machine  vision  for  determining 
the  weld  bead  and  joint  geometry.  He 
also  gave  a  detailed  description  of 
visual  processing  techniques  and  their 
application  in  welding  fabrication. 

"Flexible  Eddy  Current  Sensors  for 
Industrial  Applications"  was  the  subject 
of  a  talk  by  H.  Clergeot  (France).  High- 
performance  eddy  current  sensors  were 
designed  for  use  in  imaging  of  a  metal¬ 
lic  surface.  Sensors  achieve  high  pre¬ 
cision  and  stability,  with  rapid  digital 
acquisition  and  multiplexing.  The  com¬ 
bination  of  fast,  accurate,  rugged  sen¬ 
sors  with  the  flexibility  of  digital 
treatment  makes  an  arrangement  which  is 
useful  for  many  industrial  tasks. 

Clergeot  discussed  applications 
such  as  distance  measurement  under  ad¬ 
verse  conditions — e.g.,  high  tempera¬ 
ture — and  measurement  of  the  thickness 
of  a  metallic  layer.  Another  applica¬ 
tion  is  the  use  of  a  linear  array  of 
sensors  for  determining  the  profile  of  a 
seam.  A  numerical  method  was  used  to 
improve  the  image.  The  sensor  is  being 
tested  for  seam  tracking  and  automatic 
arc  welding. 

R.V.  Hughes  (UK)  discussed  robot 
plasma  welding  with  integral  arc  guid¬ 
ance.  A  prototype  robotic  welding  sys¬ 
tem  has  been  developed  based  on  the 
plasma-arc  process.  Results  thus  far 
have  shown  that  high-speed  welding  of 
materials  such  as  stainless  steel  , 
nimonics,  and  titanium  down  to  thick¬ 
nesses  as  small  as  0.25  mm  Is  practical. 
An  inertialess  weaving  system  is  under 
development,  and  a  prototype  unit  has 
demonstrated  the  feasibility  of  the 
technique  for  compensating  for  weld 
fit-up  inaccuracies  during  high-speed 
welding. 

Machine  vision  algorithms  for 
vision  guided  robotic  welding  were  dis¬ 
cussed  by  N.R.  Corby,  Jr.  (US).  Robotic 
welding  systems  in  the  past  have  pri¬ 
marily  been  taught  a  specific  trajectory 
to  be  welded,  along  with  appropriate 


process  parameters  for  welding  that 
path.  This  has  been  satisfactory  for 
less  demanding  applications,  but  appli¬ 
cation  to  part  fit-up  and  in-process 
variations  has  given  results  that  are 
less  than  satisfactory. 

Real-time  feedback  control  for 
machine  vision  has  been  suggested  as  a 
way  to  compensate  for  static  and  dynamic 
geometry  variations  as  well  as  to  con¬ 
trol  the  welding  process  parameters. 
Robust  forms  of  visual  processing  must 
he  used  to  deal  with  the  difficult 
visual  environment.  Corby  discussed 
techniques  for  enhancing  the  scene, 
developing  navigation  data,  and  tem¬ 
porarily'  processing  the  scene  to  derive 
process  control  data,  along  with  de¬ 
scriptions  of  the  processing  hardware 
employed . 

G.  Betz  (US)  described  a  general- 
purpose  3-D  vision  system  and  several 
applications.  The  system  uses  struc¬ 
tured  light  and  optical  triangulation  to 
digitize  the  surface  of  the  workpiece. 
The  vision  system  is  an  industrial  pro¬ 
duct  which  has  been  installed  and  oper¬ 
ated  in  both  assembly  line  and  batch 
manufacturing  operations.  The  sensor 
and  its  modular  construction  were 
described.  It  can  be  easily  configured 
to  implement  turn-key'  systems.  He  also 
described  a  more  advanced  3-D  vision 
system  which  is  not  yret  in  commercial 
production. 

Three-Dimensional  Sensing 

A  new  3-D  sensor  for  teaching  robot 
paths  and  environments  was  described  by 
M.  Ishii  (Japan).  He  proposed  a  new  3-D 
sensor  which  can  simultaneously  measure 
3-P  position  and  orientation  of  robot 
environments.  The  sensor  consists  of  a 
camera  using  a  pos ition-sensitive  device 
and  multiple  light-emitting  diodes 
(l.l'.Ds)  attached  to  robotic  devices  such 
as  a  robot's  hand  and  a  teaching  device. 
Their  3-D  position  and  orientation  are 
computed  in  real  tine  based  on  2-D  coor¬ 
dinate  values  of  the  LFDs  in  an  image 
plane  of  the  camera  and  geometrical 
relationships  among  3-D  positions  of  the 
l.F.Ds.  The  3-D  sensor  has  advantages  of 
simplicity  and  practical  usefulness  for 


getting  3-D  information  about  robotic 
devices  at  high  speed.  He  described  the 
experimental  results  of  applications  to 
visual  detection  of  a  robot's  hand  posi¬ 
tion  and  orientation,  the  teaching  of 
robot  paths,  and  the  modeling  of  robot 
environments. 

R.A.  Jarvis  (Australia)  discussed 
range  from  brightness  for  robotic 
vision.  Range  determination  has  become 
an  important  component  in  sensory-based 
robotics  research.  Registered  intensi- 
ty/rangc  data  of  good  quality  are  impor¬ 
tant  to  robust,  semantic-free,  low-level 
3-D  scene  analysis.  Jarvis  discussed  the 
use  of  brightness  variations  in  color 
imagery  as  a  means  of  recovering  range 
data.  Some  preliminary  results  of 
experimentation  carried  out  in  the  com¬ 
puter  vision  and  robotics  laboratory  at 
the  Australian  National  University  were 
presented,  and  future  plans  for  develop¬ 
ment  were  discussed. 

"3-D  Reconstruction  of  Silhouettes" 
was  the  subject  of  a  paper  by  G.  Sandini 
(Italy).  He  presented  a  stereo  algo¬ 
rithm  to  compute  the  location  in  space 
of  flat  objects  (silhouettes).  The 
algorithm  is  simplified  by  solving  the 
correspondence  problem  only  for  the 
points  of  zero  curvature  of  the  shape 
contour.  The  points  of  zero  curvature 
also  provide  good  perspective  invariants 
allowing  the  stereo  images  to  he  acquir¬ 
ed  from  different  viewpoints  (to  in¬ 
crease  accuracy).  Moreover,  because  the 
camera  parameters  and  the  viewing  geome¬ 
try  are  known,  the  matching  between 
points  of  zero  curvature  was  reduced 
from  a  2-D  problem  by  searching  for 
matching  along  conjugate  epipolar  lines. 
The  equation  of  the  plane  on  which  the 
silhouette  lies  was  determined  with  a 
precision  of  at  least  99  percent. 

R.-C.  Luo  (US)  described  a  system 
which  combines  2-D  vision  and  taction 
for  3-D  object  recognition.  A  video 
camera  is  used  to  obtain  the  top  view  of 
an  object,  and  two  tactile  sensing 
arrays  mounted  on  a  robot  gripper  are 
used  to  measure  information  about  the 
lateral  surfaces  of  the  object.  Three- 
dimensional  reference  object  models  are 
established  as  a  decision  tree,  and 
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recognition  of  unknown  objects  is  accom¬ 
plished  through  measuring  and  comparing 
input  object  features  hierarchically 
with  those  of  the  reference  objects 
associated  with  the  decision  tree.  The 
advantages  of  this  system  over  systems 
using  visual  or  tactile  information 
alone  were  discussed. 

R.J.  Fryer  (UK)  described  the 
Strathclyde  Artificial  Kotina  and  Cortex 
Heuristic  Imaging  Experiment  (ARCHIE). 
This  project  is  an  investigation  of  a 
pipelined  pseudo-parallel  architecture 
for  real-time  derivation  of  the  3-D 
structure  of  a  viewed  scene.  This 
system  will  have  an  interface  to  an 
intelligent  database  which  will  use  the 
perceived  structure,  together  with  other 
clues  such  as  color  or  texture,  to 
interpret  the  scene  and  recognize 
objects.  The  overalL  configuration 
resembles  some  schematics  of  vertebrate 
visual  systems,  hence  the  acronym. 

Nonv i sion  Sensing 

A  paper  on  "A  High  Resolution  Tac¬ 
tile  Sensor"  was  presented  by  K.  Komori- 
va  (Japan).  A  high-resolution  tactile 
sensor  using  a  pressure-optical  conver¬ 
sion  technique  has  been  developed.  The 
sensor  system  consists  of  a  transparent 
acrvle  plate,  an  elastic  sheet,  a  light- 
guide  made  of  plastic  fibers,  and  a 
12* lb  phototransistor  array.  The  elas'tic 
sheet,  a  sensing  surface,  is  placed  on 
the  acryle  plate  (36*117  mm).  The  light 
is  guided  with  a  light  guide  onto  one 
end  of  the  plate.  There  is  total  inter¬ 
nal  reflection  of  the  light  from  the 
plate  if  no  pressure  is  applied  to  the 
elastic  sheet.  Pressure  applied  to  the 
sheet  causes  an  optically  active  contact 
between  the  sheet  and  the  plate,  so  the 
total  internal  reflection  conditions  are 
changed  and  the  light  illuminates  the 
sheet.  The  sheet  scatters  the  light 
hack  in  the  area  of  the  pressure,  and 
the  patterns  of  the  pressure  area  can  be 
observed  by  a  phototransistor  array.  The 
output  of  the  array  is  transferred  to 
the  computer  serially  for  tactile  image 
processing.  The  system  performed  well 
during  an  evaluation  experiment. 


K.A.  Marsh  (UK)  described  a  method 
for  obtaining  3-1)  acoustic  images  of 
simple  objects  in  air  using  an  array 
containing  only  a  small  number  of  trans¬ 
ducers.  Each  transducer  provides  a 
pulse-echo  measurement  in  an  appropriate 
incident  direction.  The  algorithms 
involve  probabilistic  imaging  proce¬ 
dures,  use  entire  waveforms,  and  are 
based  on  the  Kirchhofi  approximation 
together  with  the  assumption  that  the 
scatterer  is  a  rigid  body.  The  results 
of  preliminary  testing  of  these  tech¬ 
niques  were  presented,  using  both 
synthetic  and  experimental  data.  The 
experimental  data  were  obtained  using 
transducers  fabricated  from  a  piezoelec¬ 
tric  polymer  which  provided  an  operating 
bandwidth  of  7  to  16  KHz,  appropriate 
for  imaging  objects  of  centimeter  dimen¬ 
sions  . 

A  paper  by  J.M.  Vranish  (US),  enti¬ 
tled  "Magnetoresistive  Skin  for  Robots," 
was  presented  by  J.F.  Blackburn.  The 
paper  proposes  a  tactile  imaging  skin 
for  robot  grippers  based  on  magnetore¬ 
sistive  technology.  In  the  design  pro¬ 
posed,  the  skin  would  consist  of  a  thin- 
film  magnetoresistive  array  with  sensor 
elements  2.5  mm  apart  covered  by  a  sheet 
of  rubber  and  a  row  of  flat  wires  etched 
on  a  mylar  film.  Linear  pressure  and 
compression  relationships  are  expected 
over  a  20-dB  range.  By  varying  rubber 
stiffness,  the  pressure  range  could  be 
set  anywhere  between  30  Newtons/m2  and 
3000  Newtons/m2  for  applications  re¬ 
quiring  sensitivity,  and  2.0*104  New¬ 
tons/m2  to  2.0*106  Newtons/m2  for  more 
rugged  industrial  uses.  By  varying 
rubber  thickness,  one  could  construct 
the  skin  to  detect  different  compression 
ranges.  For  example,  a  thin  skin 
(2.5  mm)  could  sense  compression  from 
0.0025  mm  to  0.25  mm,  whereas  a  thick 
skin  (7.5  mm),  which  is  more  compliant 
and  conformal,  could  sense  compression 
from  0.025  mm  to  2.5  mm.  Design,  opera¬ 
tion,  and  expected  performance  of  the 
skin  were  described. 

Tn  a  paper  entitled  "Application  of 
Sensory  Modules  for  Adaptive  Robots," 
A.N.  Trounov  (USSR)  discussed  three 


types  of  sensory  modules — including  con¬ 
tact  pressure,  slip  displacement,  and 
distance  and  inclination  angle  modules — 
which  have  been  developed  for  adaptive 
grippers  and  control  systems  of  indus¬ 
trial  robots.  He  described  the  main 
characteristics  of  the  sensory  modules 
anil  discussed  new  material  for  tactile 
sensors  with  a  wide  dynamic  range  of 
tactile  and  force  feedback  which  does 
not  require  amplifiers.  A  comparison 
with  carbon-fiber  and  silicon-rubber 
tactile  sensors  was  given.  Trounov 
discussed  the  design  approach  for  a 
single  sensor  and  for  modules  integrated 
into  a  complex  control  system  of  adap¬ 
tive  robots. 

J.B.C.  Davies  (UK)  described  a 
tactile  sensor  that  was  constructed 
using  the  variation  in  contact  resis¬ 
tance  between  carbon  fibers  and  a  metal 
cont.it.  Repeatability  and  accuracy  are 
not  high,  but  with  suitable  encapsula¬ 
tion  and  circuitry  a  very  robust  inde¬ 
pendent  sensor  has  been  produced. 
Feedback  can  take  the  form  of  a  con¬ 
tinuous  variation  in  resistance  or 
discrete  changes  in  LED  illumination. 

Robot  Guidance  and  Sensory  Control 

"A  Practical  Solution  to  Real  Time 
Path  Control  of  a  Robot"  was  the  subject 
of  a  paper  presented  by  P.  Sholl  (UK). 
He  described  the  real-time  path  control 
capability,  called  ALTER,  of  the  UNIMA- 
I  I  ON  robot-control  language  VAL  II.  He 
presented  the  language,  discussed  the 
communications  and  implementation 
aspii'ts  of  ALTER,  and  gave  examples  of 
Internal  and  external  path  control.  One 
specific  example  for  real-time  path  con¬ 
trol  was  included. 

A.  Casals  (Spain)  described  a 
specialized  image  processor  that  detects 
an  object’s  appearance  in  complex  scenes 
and  obtains  the  object's  coordinates  and 
orientation  in  a  very  short  time 
(100  ms).  A  low-cost  microcomputer  pro¬ 
cesses  the  information  about  the  object 
obtained  by  isolating  it  from  its  back¬ 
ground  and  processes  the  data  needed  for 
guiding  the  robot.  The  image  processor 
detects  the  object's  appearance  on  the 
scene  by  comparing  the  image  obtained. 


128x128  pixels,  with  a  scent-reference 
image.  This  image  is  continuously 
updated  to  adapt  it  to  lighting  fluctua¬ 
tions  or  variations  in  the  environment. 
The  detected  difference  between  images 
is  filtered  to  avoid  false  detections. 

C.  Meier  (West  Germany)  discussed 
sensor  technology  with  robot-mounted 
sensors.  The  extension  of  the  field  of 
application  of  industrial  robots  depends 
on  the  provision  within  the  robot  con¬ 
trol  of  freely  adaptable  techniques  for 
processing  sensor  signals.  Meier  de¬ 
scribed  how  these  sensor  functions  can 
be  used  to  provide  speed  regulation, 
on-line  path  correction,  and  adaptable 
signal  processing  in  a  manner  which  is 
easy  for  the  user  to  implement.  The 
on-line  sensor  functions  are  part  of  a 
closed-position  control  loop  or  other 
general-process  control  loop.  The  loop 
is  formed  by  the  sensors,  the  control, 
the  sensors  with  the  drives,  and  the 
robot.  The  use  of  sensors  mounted  on 
the  robot  grippers  adds  another  dimen¬ 
sion  to  the  subject.  These  sensors  are 
expected  to  work  anywhere  within  the 
working  space  of  the  gripper,  and  the 
resulting  geometrical  factors  must  be 
considered.  Meier  gave  three  examples 
of  gripper-mounted  sensors  used  to  tac¬ 
kle  problems:  recognition  and  location 
of  parts,  3-D  search,  and  path  control. 

An  experimental,  very-high-resolu- 
tion,  tactile-sensor  array  was  described 
by  D.H.  Mott  (UK).  A  pressure-intensity 
transduction  principle  was  presented  to 
construct  a  tactile  sensor  that  is  small 
and  that  offers  very  high  resolution. 
Two  robot-gripper-mounted  sensors  linked 
to  a  tactile-processing  module  and  a 
tactile  work  surface  have  been  designed 
and  built,  and  are  being  evaluated.  They 
use  the  pressure-intensity  transduction 
principle. 

Knowledge-Based  Sensory  Systems 

J.  Foster  (UK)  discussed  the  devel¬ 
opment  of  an  expert  system  for  automatic 
industrial  inspection.  The  Joyce-Loebl 
Magiscan  system  has  been  used  for 
inspecting  complex  industrial  assemblies 
for  many  years.  The  knowledge  base  and 
experience  so  obtained  are  now  being 
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used  to  develop  an  expert  system  for  the 
automatic  inspection  of  surface  texture 
and  finish  of  industrial  components. 
Foster  gave  two  examples  of  the  applica¬ 
tion  of  these  techniques — the  inspection 
of  explosive  detonator  material  and  the 
classification  of  wooden  staves.  The 
system  makes  automatic  measurements  of  a 
number  of  key  parameters  and  by  intelli¬ 
gent  assessment  decides  upon  the  quality 
or  grade  of  the  component.  Self-learn¬ 
ing  is  used  to  allow  the  system  to 
accommodate  different  components  and 
ranges  of  materials  from  which  the  com¬ 
ponents  can  he  manufactured. 

A  pragmatic  approach  to  the  bin¬ 
picking  problem  was  discussed  by  0. 
Ledoux  (Belgium).  He  proposed  a  prag¬ 
matic  visual  method  to  grasp  parts  from 
a  bin.  The  locating  and  recognition  of 
an  object  is  done  in  two  steps.  First, 
the  system  looks  for  a  grasping  site. 
The  image  processing  is  based  on  an  edge 
operator,  computed  on  a  64-grey-levels 
image,  to  find  some  parts  of  the  ob¬ 
ject's  outline.  Second,  the  vision  sys¬ 
tem  models  two  opposite  parts  of  the 
object's  outline  and  tries  to  find  a 
grasping  site  when  the  fingers  of  the 
gripper  fit  this  modeled  outline.  In  the 
second  step,  the  part  is  on  a  flat  sur¬ 
face  below  another  camera  where  lighting 
conditions  are  easily  controlled  and 
where  the  part  is  isolated.  This  simpli¬ 
fied  scene  is  then  analyzed  by  conven¬ 
tion.)  1  means. 

P.d.  Gregory  (UK)  described  know¬ 
ledge-based  models  for  computer  vision. 
Vision  systems  capable  of  analysis  of 
grey-scale  images  are  now  becoming 
available  and  offer  the  potential  to 
handle  the  complex  inspection  require¬ 
ments  of  today's  manufacturing  industry. 
Their  widespread  use  is  likely  to  be 
limited  by  the  cost  of  developing  appli- 
cat ions-spec i f ic  software  that  is  suffi¬ 
ciently  robust  to  achieve  acceptable 
inspection  performance.  By  using  a 
"knowledge-based  model"  to  direct  the 
analysis,  one  can  improve  performance 
while  allowing  programming  to  be  per¬ 
formed  by  nonexpert  users  in  a  graphical 
manner.  An  example  from  the  automobile 
industry  was  discussed. 


A  conceptual  approach  to  artificial 
vision  was  described  by  G.  Adorni 
(Italy).  Object  descriptions  based  on 
geometrical  features  are  not  very  satis¬ 
factory  because  of  wide  variations  in 
structure  and  shape  often  due  only  to 
style.  A  more  functional  description  is 
needed,  which  in  turn  requires  some 
knowledge  about  the  everyday  experienced 
physical  processes  in  order  to  be  linked 
to  the  observed  shapes.  For  example, 
knowledge  of  the  function  of  a  chair,  if 
stored  in  the  knowledge  base,  can  be  of 
help  in  the  process  of  recognizing  a 
shape  as  a  chair.  Some  preliminary 
geometrical  operations  on  visual  data 
were  also  discussed,  and  a  method  for 
integrating  structural  and  functional 
information  was  proposed. 

Advanced  Vision  Techniques 

R.B.  Kelley  (US)  described  a  heu¬ 
ristic-vision  hole  finder.  In  the  usual 
methods,  the  holes  must  be  of  known 
shape,  and  corrections  are  needed  to 
account  for  perspective  distortion  or 
hole  surface  orientation.  Heuristic- 
vision  algorithms  are  based  on  the 
notion  of  locating  good  hold-sites  on 
some  part  of  the  objects  seen  by  the 
camera.  The  algorithms  can  be  unin¬ 
formed  about  the  nature  of  the  object 
itself.  The  heuristic-vision  hole  finder 
seeks  edge  patterns  which  correspond  to 
holes.  By  using  neighborhood  operators 
applied  in  both  horizontal  and  vertical 
stripes  across  the  image,  the  hole  cen¬ 
ters  are  located  directly.  The  algo¬ 
rithm  requires  modest  computation  and  is 
designed  to  minimize  execution  times. 

Local  ordered  grey  levels  as  an  aid 
to  corner  detection  was  the  topic  of  a 
paper  by  K.  Paler  (UK).  He  presented  a 
novel  method  for  detecting  corner  points 
in  a  scene.  The  method  is  based  on 
features  extracted  from  the  distribution 
of  ordered  grey  level  values  within  a 
local  window.  The  algorithm  is  inde¬ 
pendent  of  the  orientation  of  the 
objects  in  the  scene.  Paler  presented 
results  for  an  image  containing  corners 
of  different  angles  and  orientat ions.  A 
comparison  was  made  between  the  posi¬ 
tions  obtained  for  the  eorners  detected 
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using  this  method  and  those  obtained  by 
direct  measurement.  The  signal 

strengths  of  similar  corners  at  differ¬ 
ent  or  ient.it  ions  were  also  compared. 
These  comparisons  show  that  the  proposed 
algorithm  can  provide  useful  corner- 
point  information  without  the  need  for 
preprocessing  of  the  image. 

I).  Juvin  (France)  presented  a  paper 
on  a  heuristic  method  of  classification 
and  automatic  inspection  of  parts.  The 
recognition  system,  AN1MA,  does  part 
recognition  of  objects  with  a  limited 
number  of  stable  positions  in  an  indus¬ 
trial  environment.  He  first  described  a 
contour  encoding  of  the  pattern  to  be 
recognized,  which  is  invariant  in  trans¬ 
national  and  rotational  modes.  This 
encoding  keeps  the  geometric  aspect  of 
the  contour.  The  algorithm  then  carries 
out  the  identification  of  the  shapes  to 
he  recognized  by  using  a  Fuclidean  dis¬ 
tance  specified  in  terms  of  the  invari¬ 
ant  encoding.  Through  this  distance  an 
estimate  of  the  shape  distortion  and  the 
recorded  selected  reference  is  obtained. 
A  dynamic  acceleration  heuristic  using  a 
proe I  ass  if  icat ion  technique  has  been 
implemented  on  an  INTEL  8086  micropro¬ 
cessor.  It  carries  out  the  object  recog¬ 
nition  and  location  of  pre-recorded 
poin' s  by  reference  to  10  recorded 
shapes  in  less  than  one  second. 

A.  I*.  Ambler  <TK)  described  the  use 
oi  '  is  ion  verification  in  the  RAPT  sys¬ 
tem.  RAI’T  is  an  off-line  robot-program- 
i  i.g  language  who-h  use  descriptions  of 
spat  ial  constraint:,  between  features  of 
objects  to  determine  the  planned  posi- 
t  ions  of  objects.  "Vision  verification" 
i>  tin1  use  of  vision  information  to 
determine  the  difference  between  the 
planned  pesitions  and  the  actual  posi¬ 
tions  taken  up  at  run  time.  Ambler 
showed  how  vision  commands  can  be  used 
t •'i  a  1 1  ow  the  combination  of  run-time  and 
comp i I e-t ime  information  in  a  general 
w iv  so  that  all  ramifications  of  the 
effect  of  the  changed  position  are  taken 
into  account.  Tit  i  s  involves  symbolic 
’oni  oning  about  '  p. it  ial  constraints  at 
compile  time  ano  i  he  .instruction  of  a 
framework  indicating  the  dependence  of 
oh  loot  pos, lions  on  ear h  other. 


W.H.  Tsai  (Taiwan)  described  a  3-1) 
object  recognition  system  capable  of 
measuring  3-D  object  surfaces.  The  sys¬ 
tem  is  simple,  efficient,  and  relatively 
inexpensive.  It  relies  on  parallel- 
stripe  projections  for  3-D  surface  meas¬ 
urement.  Data  from  four  camera  views 
are  collected  to  form  reference  models 
which  consist  of  horizontal  cross-sec¬ 
tion  boundaries.  The  recognition  scheme 
engages  3-D  object  registration  followed 
by  3-D  similarity  measurement.  The  3-D 
registration  is  accomplished  by  multiple 
2-D  registrations  on  the  cross-section 
planes  using  the  generalized  3-D  Hough 
transform.  The  3-D  similarity  measure 
uses  the  average  of  all  the  2-D  cross- 
sectional  similarity  measures,  which  are 
based  on  the  "distance-weight  correla¬ 
tion."  Since  the  recognition  scheme 
involves  only  pixel-level  operations,  it 
is  amenable  to  parallel  processing. 

"Techniques  of  Muitisensor  Signal 
Processing  and  Their  Application  to  the 
Combining  of  Vision  and  Acoustical  Data" 
was  the  subject  of  a  paper  by  J.M. 
Richardson  (US).  He  considered  first 
the  general  problem  of  single-time  state 
estimation  when  the  measured  data  are 
produced  by  sensors  of  different  types. 
He  discussed  the  kind  of  signal  process¬ 
ing  involved  in  the  merging  of  the  sen¬ 
sor  outputs.  Other  questions  pertinent 
to  the  later  stages  of  the  total  state- 
estimation  problem  were  discussed.  He 
gave  as  an  illustration  the  pr-.  Idem  (if 
estimating  the  1-D  geomvt tv  of  an  ohjoit 
using  a  comhin.it  (on  ot  data  ;  rom  an 
acoustical -scattering  men su remen t  system 
and  an  optical  system.  The  treatment 
was  limited  to  convent  ional  monocular 
optical  systems  involving  a  variety  of 
illumination  directions.  Results  based 
on  synthetic  data  were  presented  and 
evaluated . 

Conclusion 

The  conference  represented  a  good 
state-of-the-art  samplt  of  rest  arch  in 
robot  sensing.  Vision  .,etis  ing  v.  s  pre¬ 
dominant,  but  there  v-:  sevora !  good 
papers  on  tactile  sensing  ns  well.  1  he 
papers  show  convincingly  that  the 
present  state  of  development  permits 
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sensor-based  manufacturing.  It  is  now 
possible  to  move  from  fixed  automation 
in  which  a  robot  follows  a  prescribed 
set  of  motions  which  have  been  "taught" 
to  a  flexible  automation  in  which  visual 
and  tactile  feedback  permit  adaptation 
of  the  robot's  motion  to  unforeseen 
changes  in  the  workpiece  or  the  environ- 


visual  and  tactile  sensing,  feedback 
seam  tracking  is  practical  and  the  use 
of  robots  for  arc.  welding  is  greatly 
increasing.  It  has  also  become  possible 
to  use  robots  in  assembly  with  the  use 
of  parts  recognition  through  visual 
sensing  and  bin  picking  of  parts  and 
assembly  of  products  by  robots. 


This  capability  is  responsible  for 
a  great  increase  in  the  use  of  robots 
and  machine  vision  in  computer- inte¬ 
grated  manufacturing.  Spot  welding  and 
r.prav  painting  have  been  predominant  in 
the  use  of  robots  in  the  automobile 
manufacturing  industry.  Now  due  to 
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